Hell I removed the rear speakers and just run with two up front so I can hear traffic reports when I take it to work.
But that is the good thing with the charger. I have the pigtails setup so I don't have to open the trunk or anything. I just pull in the garage and plug in the quick connector and leave it there till I need to go somewhere. It will trickle charge without damaging the battery indefinitely.